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METHOD AND DEVICE FOR MONITORING AND FAULT DETECTION 
IN INDUSTRIAL PROCESSES 

Technical field 

The present invention relates to a method and a device of monitoring and fault de- 
tection in industrial processes. More specifically, the present invention relates to a 
method of applying multivariate techniques in the sequential transfer of quality pa- 
rameters by means of score values and monitor tiiie process with early fault detec- 
tion. 

Technical backgroimd 

In today's world of outsourcing, many of the steps in manufacturing process are 
actually made by other companies than by the company responsible for the final 
product. Examples of products assembled in such a way include cars, computers, 
and telephone exchanges. The same approach applies to a product manufactured in 
several steps without assembly, e.g., a pharmaceutical tablet, a roll of printing paper, 
or a wafer in a semiconductor process. Sequential manufacturing makes for a strong 
need of tracking quality data through the whole manufacturing tree, assuring that all 
components and sub-components, as well as their combinations, have adequate 
quality, faults are early (high up) discovered in the tree, etc. When multiple data are 
measured in process steps and component quality testing, only multivariate tools can 
adequately use tiie information to evaluate the quality in the tree of manufacturing 
steps. 

The products of today must meet increasing quality demands. The product quality is 
measured by many parameters and depends on many process variables in each step 
of the process chain. During each manufacturing step, process data are measured at 
certain intervals to control and monitor the process, and after each step intermediate 
quality data are measured on the sub-components and components, and then fibaal 
quality data are measured on the final product However, even if many quality 
measurements are used, with reliance on traditional Statistical Process Control 
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(SPC) the small tolerated variation of each component leads to major difficulties, 
and rejection of a portion of well working product 

Several techniques are used for the purpose of monitoring a process. Parameters to 
5 check include quality, yield, energy, product rejection, etc., A conventional ap- 
proach for monitoring a process is to consider one variable at a time (univariate SPC 
). This approach is not adequate for obtaining the best quality, economy, etc. of a 
product in a manufacturing process, since actually several variables are involved. 

10 The most commonly employed type of SPC uses single variable control charts. 
When a given product or process is outside of a specification it is indicated. The 
limitation with SPC is that only few variables, generally at the most around S, can 
be used for monitoring the process. 

15 The quality of intermediate and end products is in most cases described by values of 
a set of variables, the product specification. The specifications are often used in a 
univariate mode, i.e. they are checked individually for conformation within the 
specification value range. This gives rise to both felse negative and false positive 
classification, since the quality variables very rarely are independent in practice, but 

20 are treated as if they were, i.e. univariately. 

It is possible to use traditional. SPC to estabUsh when a process is out of specifica- 
tion when only a few variables are involved. However, when the number of process 
variables and quality increase or when they interact, problems arise. Very often it is 
25 difficult to determine the source of the problem, particularly when the number of 
process variables increases. Product quality is typically a multivariate property and 
must be treated as such in order to monitor a process in that respect 

In order to optimize and control a process with several variables, projection tech- 
30 niques such as Principal Components Analysis (PCA) and Projection to Latent 

Structure (PLS) have been appUed. These techniques are well described (Mac Gre- 
gor et. al.) and ftirther development has been made to address the process control 
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need of today. S.Wold et al (ffierarchical multi-block PLS and PC models, for eas- 
ier interpretation, and as an alternative to variable selection, J.Chemometrics 10 
(1996) 463-482), describes a method where the variables are divided into conceptu- 
ally meaningful blocks before applying hierarchical multi-block PLS or PC models. 
5 This allows an interpretation focused on pertinent blocks and their dominant vari- 
ables. Such blocking can be used in process modeling and modeling. 

Attempts based on SPC and projection techniques have been made to control a pro- 
cess. WO 99/19780 describes a method and device for controlling an essentially 

10 continuous process comprising at least two sub-processes, which minimizes the re- 
jection of the produced product The method is based upon combining multivariate 
models witih a processed variable value. A variable value for a subsequent second 
sub process is predicted based on the combmation of the multivariate model and the 
processed variable value. However, the method only utilizes multivariate data 

15 analysis in respect of controlling the process and not for checking or monitoring. 
Furthemiore the method is applied only for a specific application and can not be 
used in general applications. 

C. Wikstrom et aL (Multivariate process and quality monitoring applied to an elec- 
20 trolysis process. Part 1 . Process supervision with multivariate control charts Che- 
mometrics and intelligent laboratory system 42 (1998) 221-23 1), describes Multi- 
variate Statistical Process Control (MSPC) applied to an electrolysis process and the 
benefit with multivariate analysis over traditional univariate analysis is discussed 
Moreover the article shows how the result from a multivariate principal component 
25 analysis method can be displayed graphically in multivariate statistical control 

charts. By using this informationally efficient MSPC approach, rather than any inef- 
ficient SPC technique, the potential of achieving major improvements in the under- 
standing and monitoring of the process is shown. The improvements are, however, 
not sufficient to be able to control the quality problems in complex processes unless 
30 ^ecific experimentation has been made to make the multivariate model invertable 
and thus also capable to determine how the process should be modified to minimize 
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deviation from the specification profile. In MSPC as well as SPC "controlling" 
should be synonymous with "checking" or "monitoring". 

Another drawback with the application of prior art to sequential manufacturing is 
5 the need to carry relevant information from differrat process steps in a process 
chain, which can not be easily achieved by known techniques. Therefore, a need 
exists to describe product quality in a sequential monitoring process by a multivari- 
ate model of the relevant quality variables rather than the individual variables them- 
selves. 



A problem with prior art (univariate SPC) is that the quality variables are not inde- 
pendent, but their interdependencies get lost if they are analyzed or monitored indi- 
vidually. The risk for false product approval increases and when this occurs and is 
fed back in the supply chain the specification intervals are usually narrowed in order 
15 to secure product. However, this rarely eliminates the problem of false product ap- 
proval and also give rise to substantial false rejects. 

Smnmarv of invention 

20 The present invention is directed to overcoming the problems set forth above espe- 
cially to monitor and detect faults at the earliest possible stage in a process chairL 

This is accomplished according the invention by a method for monitoring of and 
fault detection in an industrial process, comprising at least a first sub-process and at 

25 least one second sub-process arranged in a process chain, comprising, for the at least 
one second sub-process the steps of collecting data and calcxilating a multivariate 
sub-model based on the collected data, said method being charactmzed by the steps 
of receiving in the first sub-process from the at least second sub-process information 
related to the multivariate sub-model calculated for the at least second sub-process, 

30 collecting data related to the first sub-process, and calculating a multivariate sub- 
model for the first sub-process based on collected data and received information. 



10 
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The current invention provides a method and a device for multivariate quality as- 
sessment and sequential transport of quality measures between subsequent produc- 
ing entities. Early fault detection in the process chain is achieved by fault diagnosis 
tools such as outlier detection etc., and on-line monitoring of new data measured 
5 from the beginning of the manuiEacture chain. This methodology has several advan- 
tages compared to traditional univariate quality assessment. The risk for false prod- 
uct approval decreases. Multivariate quality assessment allows the number of qual- 
ity variables to increase and still be meaningftd as product specification. This is due 
to the inherent capability of multivariate techniques to reduce dimensionality with- 
10 out losing relevant information m the data. This allows for instance inclusion of en- 
tire spectra from spectroscopic measurements to be used as quality assessment. Near 
Infra Red (NIR) sepctroscopy has become increasingly used for this purpose. 

It is also possible to predict product properties directiy from the process, i.e. to 
15 translate the production state into predicted product properties. This is sometimes 
called soft sensors. 

In multivariate quality assessment the quality data from good product samples are 
used to build a multivariate model using PCA or PLS. Each produced unit is then 
projected on this model and classified according to its dissimilarity to the model. 

20 

The current invention use multivariate models in sequence. The producing entity 
applies a multivariate model for describing the quality. This model consists of a 
number of latent variables, the same latent variables are used by the receiving entity 
as a means of checking the quality of each delivered unit. But they can also be used 
25 as X- variables in the receiving entity's process step to give quality assessment of 
each individual step taken into use into the further processing. 



30 



The data are arranged in a dynamically updated tree with the root being the final 
product data and each branch and twig being the data of a component or sub- 
component. 
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This feature concerns a novel method to analyze multivariate data from a tree 
structured manufacturing process. In a preferred embodiment this novel method 
gives information about each manu&cturing step and its results, as well as the com- 
bined influence of all upstream C*up-tree") steps on later steps and on the final 

5 product Preferably the novel approach allows the detection of &ults and upsets in 
separate steps as well as in combiaations of several or all steps, and points to which 
process variables and steps that together are related to these faults. Thus, an over- 
view of all the process data are obtained in a way corresponding to the structure of 
the process, providing information about the overall quality as well as the quality of 

10 each individual step. 

Preferably this novel approach provides an adequate infrastructure to monitor a 
complicated chain of components manufacturing and assembly in such a way that 
the adequate quality of the final product is assured. Pertinent graphics are included, 
15 showiag the status of the overall chain as well as parts and individual steps in terms 
of one-, two-, and three-dimensional multivariate control charts. Additional multi- 
variate plots are included for the detailed interpretation of the patterns seen in these 
control charts. 



20 We here discuss the novel approach as applied to the discrete manufacturing of a 
product consisting of components and sub-components, e.g., a computer, a tele- 
phone, a car, or a camera. Precisely the same approach applies also to a product 
manufactured in several steps without assembly, e.g., a pharmaceutical tablet, a roll 
of printing paper, or a wafer in a semiconductor process. 

25 

Brief description of the drawing s 

Figure 1 shows the information flow in a simple straight chain sequence and quality 
dataY. 

30 

Figure 2 shows the information flow in a simple example of a "forked" sequence. 
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Figure 3 shows PLS regression coeflSlcients (b) for step 1 1, yl 1 (left), xl 1 and xl2 
are seen to dominate both y-models, and xl4 is unimportant. 

Figure 4 shows PLS regression coefficients (b) for step 1 1, yl2j, xl 1 and xl2 are 
S seen to dominate both y-models, and xl4 is ununportant 

Figure 5 shows the data structure for a simple process with four steps with two 
merging branches in the final step. 

10 Definitions 



An ''industrial process" means a process comprising one or several steps performed 
within that specific process or one or several steps performed at sub processes, and 
could be described as a multivariate process. 

15 

Bold characters are used for vectors and matrices, lower case for vectors, e.g., u, 
and upper case for matrices, e.g., X. 



The process consists of J steps (j=l, 2,. . .,J), where we assume that the last (J) is the 
20 final step, giving the final product. 

One ''NIPALS-PLS round" means firom present u's (local and from chain below), 
use an average of these u's, multiply Ihat into X to give w', normalize w, calculate t 
and X w, and finally c as t' Y/(t't). 

25 The training set is the historical data measured on all steps fi-om instances of accept- 
able product, N observations with the individvial index i (i=l,2,. . .,N), these data will 
be used to develop a model of how data in all steps and in their combination should 
look for acceptable product. 



30 



On each step (j), multiple process variables (Xj^) ^ measured, with the value of the 
individual observation being Xyi^. For step j, the training set data comprise the matrix 

Xy 
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OptionaUy, after each step 0), quality variables (y^J are measured, with the value of 
the individual observation being y^. For step j, flie training set data comprise the 
matrix Y,. For steps lacking quaUty data (y), principal components like calculations 
will be made, for steps having quaUly data PLS like calculation will be made. 

A coefficient bjk shows how much a variable^jt contributes to the model of step 11. 

A sub-process is a process step in a straight process chain, a forked process chain or 
a combination of both. 



A sub-model is a multivariate model calculated for a specific subprocess, which c 
include information from one or several sub-models. 

OutUers could be samples lhat are out of a specification, outside a process control 
limit, etc.. 



The items displayed in a score plot are the score values of the observations for a 
specified set of model components (model dimensions), often components one and 
two, or one, two, and three. The score values are weighted averages of all variables 
(measurements, properties) with the weights determined by (a) the loadings of the 
variables of the specified model components, and (b) the scaling parameters of the 
corresponding model. Thus, the scores are new variables that constitute summaries 
of the original variables. Deviations in the score values of an observation from the 
normal intervals of these scores indicate the observation to be different from the 
ones situated within the normal score intervals; it is an outUer. 



A scaled raw data (contribution) plot for an observation, shows the difference be- 
tween its individual variable values m scaled form and the corresponding scaled 
values of a reference observation. This reference observation is often the (hypotheti- 
cal) average of all "good" observations (giving good final quality) in the training 
set, or tiie set point of manipulated variables together witii die average values of the 
otiier variables. The scaled raw data (contribution) plot mdicates which combination 
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of variables that is related to the significant deviation of the observation (making it 
an outlier) - these are the variables deviating the most fi-om their "normal*' values. 
Thus the scaled raw data (contribution) plot is useful for finding the reason for an 
observation deviating fi-om the "normal" onra, as seen in, for instance, a score plot 
5 or a residual std dev (DModX) pl<>t- 

A residual std dev (DModX) plot describes how much the scaled data vector of each 
observation differs from its "ideal", this being the model value of the observation, 
i.e., the weighted sum of the model loadings with the weights being the score values 
10 of the observation. A large residual std dev (DModX) value, significanfly outside its 
normal range, indicated that this observation deviates fix>m the model of the normal 
observations, it is an outiier. The indications for process upsets are often seen first in 
the residual std dev (DModX) plot. 

15 Detailed description of the invention 

In the following the invention will be described in more detail by means of exam- 
ples which are provided for illustrative purposes only and are not intended to limit 
the scope of the invention. 

20 

Like any modeling, sequential multivariate modeling is made in two phases; 

(1) a "training'' phase based on historical data leading to a multivariate model. In 
the present case this consists of, a chain of multivariate submodels. 

25 

(2) a "prediction" phase where the model fi-om phase (1) is used to evaluate new 
incoming data to detect deviations from "normal operation", and predict 
properties of the resulting product or intermediate product of a subprocess. 

30 In the present case of sequential modeling, historical data are collected for each step 
in the manufacturing process chain, and a sub-model is developed for each such 
step. The models are then coimected in a chain corresponding to the process chain 
(this coimection can be done in several slightiy different ways), and in the prediction 
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step applied on-line to production data for diagnosis and quality assessment and 
prediction of quality further down the chain. 

Early fault detection in the process chain is achieved by feult diagnosis tools such as 
outlier detection etc. Plots such as contribution, score, coefficients etc. can be used 
as diagnosis tools. On-line monitoring of new data measured from the beginning of 
the manufacture chain, give information about the status of the process chain in total 
as well as each of it's steps, and identifies the from normal process operation in out- 
liers in scores and other diagnostic plots. 

Examples 

In the following two small examples we will indicate how information from one 
step of a sequential process can be carried "down stream" by means of scores of a 
multivariate model of the step. Subsequent steps will use these scores as variables 
together with the process variables in those subsequent steps. 

In this way one gets a monitoring approach, which a) each intermediate product 
meets specification and b) ensures that all intermediate products from different pro- 
cess streams fit together ui intermediate and final products. In addition to process 
monitoring and only fault detection, this can be used, for instance, to match inter- 
mediates when the intermediate product differ in size, large ones go together, and 
small ones go together or, just to make sure that the final product has all properties 
in the right proportion, including those of its components. 

To illustrate the models, information flow, and algorithms, two small illustrative ex- 
amples are given below with only 5 observations and three steps in each. 

The simplest sequential algorithm is used for the illustration, where separate stan- 
dard two block (X,Y) PLS models (no hierarchical structure) are made for the "left 
end" blocks of each chain, i,e., block (XI, Yl) in Figure 1, and blocks (X4, Y4) and 
(X5, Y5) in Figure 2. Thereafter die scores (tl 1, tl2, t41, t42, t5) of these blocks are 



• 
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included as extra process variables in the blocks (X2, X6) next to the right (down 
stream) of these **end blocks", and PLS models made of these blocks. The resulting 
scores are then used as extra process variables in the blocks next to the rigiht (down 
stream), etc., until the end. 



This simplest way of calculation gives two PLS-components for stepl 1 in Figure 1, 
the same for step 21 in Figure 2, and one component for step 22 in Figure 2. 

Referring to Figure 1, a straight chain sequence in three steps is shown. We may 
think of this as a very simple example of a pharmaceutical naanufacturing, where a 
tablet is made in three consecutive steps; granulation (step 1 1), miying (step 12), 
and tabletting (step 13). The three model properties are shown in table 1. 



Table 1 



Model 


Number of vari- 
ables (X's) 


Number of t*s from 
previous step 


Number of measured 
quality variables (Y 's) 


ResuUiug mmiber 
of PLS com^Kments 


step 11 


4 




2 


2 


step 12 


3 


2 


1 


3 


step 13 


3 


3 


2 


3 



Step 1 1, this first step simulates a simplified gramilation with four process variables 
(e.g., temperature (xl 1), flow (xl2), concentration (xl3), spray pressure (xl4)) and 
two measured quality variables (responses), e.g., granulate particle size (yl 1) and 
homogeneity (y 12) (standard deviation of particle size). The data values below have 
berai centered (average subtracted) and scaled, to make them uninteresting as such. 

Table 2 shows data Xl=[xl 1, xl2, xl3, xl4] and Yl=[yU, yl2] of step 1 1, together 
with resulting two score vectors tl 1 and tl2, and PLS coefiScients w* and c. In the 
PLS model, the scores are calculated Jfrom the raw data as: tj, = xjt w^t*, and each 
y-vector is modeled by the scores as: = Ea tia <^am + fim (residuals), or, equiva- 
lently, yim = Xjk + . The data are analyzed in original form, with no addi- 
tional centering or scaling. 
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obs / vec 


xll 


xl2 


xl3 


xl4 




yii 


yl2 




til 


tl2 


1 


0.188 


0.076 


0.175 


0.091 




0.248 


0.191 




0.280 


0.062 


2 


-^.316 


0.029 


-0.367 


-0.379 




-0.314 


-0,250 




-0.553 


0.143 


3 


0.599 


0.023 


0.561 


0.591 




0.624 


0.563 




0.951 


-0.127 


4 


-0.033 


0.312 


-0.213 


-0.335 




0.028 


0.139 




-0.175 


0.435 


5 


-0.438 


-0.441 


-0.156 


0.032 




-0.587 


-0.644 




-0,503 


-0.513 
























6 


0.63 


0.061 


0.587 


0.507 










0.963 


-0.047 


7 


0.83 


0.001 


0.9 


0.807 










1.366 


-0.212 
























w* and c 1 


0.699 


0.295 


0,514 


0.401 




0.717 


0.653 








w* and c 2 


0.368 


0.813 


-0.139 


-0.487 




0.415 


0.600 








byll 


0.653 


0.549 


0.311 


0.085 














byl2 


0.677 


0.680 


0.253 


-0.031 















Data CXI and Yl), scores (tl 1 and tl2), and model coefficients (w*, c, and b) of 
step 11 are shown in table 2. Observation 6 and 7 constitute die "prediction set", 
which is not used for model development, but rather to simulate the "on-line" 
monitoring of the process at a later stage. 



The regression coefficient plot of yl 1 shown in Figure 3, indicates that variable xl 1 
and xl2 dominate the yl 1-model and that xl4 is unimportant The regression coef- 
10 ficient plot of y 12 shown in Figure 4, indicates that variable xl 1 and xl2 dominate 
the yl2-model and that xl4 is imimportant. Further the variable xl3 is seen to be 
about half as important as the dominating xl 1 and xl2 in both y-models. 

Step 12, in this simulated mixing step, has three process variables, feed rate of the 
15 constituents (x21), stirring rate (x22), and mixing time (x23). There is one y- 

variable, the resulting homogeneity (y2). As in step 1 1, the data are centered and 
scaled to make them uninteresting as such. 

Li this step, the influence of step 1 1 is modeled by means of the two scores resulting 
20 in the step 1 1 model. These two vectors (tl 1 and tl2) are appended to the X2-matrix 
of step 12 to give totally five variables (x21, x22, x23, tl 1, and tl2) in the X-matrix 
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of step 12. The PLS analysis of these data gives three components, the scores of 
which are used as additional variables in step 13. Step 12 data (X2 augmented with 
the two scores of step 1 1, and Y2), scores (t21, t22, and t23), and Y = Y2, and mod- 
els coefScients (w*, c, and b), are shown in table 3. 



Table 3 



obs/vec 


x21 


x22 


x23 


til 


tl2 




y2 




t21 


t22 


t23 


1 


-0.364 


-0.355 


-0.287 


0.280 


0.062 




-0.336 




-0.339 


-0.278 


0.364 


2 


0.197 


0.096 


0.164 


-0.553 


0.143 




-0.250 




-0,121 


0,227 


-0.456 


3 


0.427 


0.454 


0.423 


0.951 


-0.127 




0.979 




1.091 


-0.347 


-0.026 


4 


-0.358 


-0.279 


-0.395 


-0.175 


0.435 




-0.840 




-0.726 


-0.334 


-0.104 


5 


0.098 


0.084 


0.095 


-0.503 


-0.513 




0.447 




0.095 


0.731 


0.221 


























w* and c 1 


0.448 


0.436 


0.453 


0,481 


-0.416 




1.005 










w* axidc2 


0.064 


0.049 


0.091 


-0.568 


-0.830 




0.340 










w* andc3 


-0.409 


-0.282 


-0.303 


0.305 


-0.909 




0.380 










b y2 


0.317 


0.347 


0.371 


0,406 


-1.046 















10 



Step 13, in tMs simulated tabletting step, there are three process variables, punching 
pressure (x3 1), machine speed (x32), and filling rate (x33). There are two y- 
variables, the resulting tablet hardness (y3 1) and uniformity (y32). As previous 
steps, the data are centered and scaled. 



In this step, the influence of step 12 (and indirectly of step 1 1) is modeled by means 
of the three scores resulting in the step 12 model. These three vectors (t21, t22, and 
15 t23) are appended to the X3-matrix of step 13 to give totally six variables (x3 1, x32, 
x33, t21, t22, and t23) in the X-matrix of step 13. 



20 



The PLS analysis of these data gives three components, denoted t3 1, t32, and t33 
below. Step 13 sq data (X3 augmented with the three scores of step 12, and Y = 
Y3), and model coefficients (w*, c, and b), are shown in table 4. 
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obs/vec 


x31 


x32 


x33 


t21 


t22 


t23 




y31 


y32 




t31 


t32 


t33 


1 


0.409 


-0.120 


0.180 


-0.339 


-0.278 


0.364 




0.633 


-0.128 




-0.105 


0.526 


0.499 


2 


-0.098 


0.086 


-0.013 


-0.121 


0.227 


-0.456 




-0.446 


-0.189 




-0.179 


-0.152 


-0.478 


3 


0.099 


0.479 


0.301 


1.091 


-0.347 


-0.026 




0.411 


1.310 




1.269 


-0.047 


-0.039 


4 


-0.156 


0.075 


-0.086 


-0.726 


-0.334 


-0.104 




0.422 


-0.875 




-0.544 


0.547 


-0.226 


5 


-0.254 


-0.520 


-0.382 


0.095 


0.731 


0.221 




-1.020 


-0.117 




-0.441 


-0.874 


0.244 






























w* andc 1 


0.178 


0.337 


0.279 


0.835 


-0.280 


0.049 




0,353 


1.044 










w* and c 2 


0.272 


0.264 


0.262 


-0.489 


-0.736 


0.081 




1.102 


-0.349 










w* and c 3 


0.376 


-0.397 


0.041 


0.094 


-0.061 


0.836 




0.286 


0.247 










by31 


0.470 


0.297 


0.399 


-0.217 


-0.927 


0.345 
















by32 


0.183 


0.161 


0.210 


1.065 


-0.049 


0.230 

















Figure 2 has a "fork", where the last step receives material (and information) from 
two chains, each with just one step. This may be seen as a simplified version of the 
manufacturing of a small computer, putting together two components, say a mother 
board and a power source, as a last step. Here, in addition to the training set of five 
observations, a prediction set with two additional observations is used to show tiie 
prediction phase of the analysis. 



Note that step 2 1 is identical to step 1 1 in Figure 1 above, and hence not shown 
again below. The three models have the following properties, shown in table 5. 



Table 5 



Model 


Number of 


Number of t's from 


Number of measured 


Resulting number of 




variables QC's) 


previous step 


parameters (Y's) 


PLS components 


step 21 


4 




2 


2 


step 22 


3 




1 


1 


step 23 


3 


3 


2 


3 



Step 21 in Figure 2 is simulated to have the same data as step 1 1 above shown in ta- 
ble 2, i.e. X1=X4, Y1=Y4, tll=t41, and tl2=t42, and is hence not further discussed. 
Of course the variables here (for a computer motherboard manufacturing) are differ- 
ent fi"om those of a pharmaceutical granulation, but after centering and scaling they 
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here are identical in values to simplify the examples. Hence also the PLS model of 
this step is identical to that of step 1 1 . 



Step 22 in Figure 2, here the X-data have the same number of variables and the 
same values as step 12 in Figure 1 . However, since there is no step preceding step 
22 in the forked model, the PLS model is not identical, and hence the table of data 
and results is given below. Only one PLS component is significant 



Step 22 data (X5 and Y5), score (t5), and model coefficients (w*, c, and b). Both the 
10 prediction set observations, 6 and 7, fit the model within the 5 % level, in table 6. 



Table 6 



obs/ vec 


x51 


x52 


x53 




y5 




t5 


DModX 


PmodX 


1 


-0,364 


-0.355 


-0.287 




-0.276 




-0.580 






2 


0.197 


0.096 


0.164 




0.153 




0.266 






3 


0.427 


0.454 


0.423 




0.431 




0.752 






4 


-0.358 


-0.279 


-0.395 




-0.422 




-0.598 






5 


0.098 


0.084 


0.095 




0.113 




0.160 


























6 


0.312 


0.510 


0.579 








0.816 


3.260 


0.048 


7 


-0.368 


-0.540 


-0.521 








-0.820 


2.573 


0.085 






















w* and c 1 


0;600 


0.548 


0.584 




.0.587 










by5 


0.352 


0.321 


0.342 















Step 23, in tbis simulated manufacturing step comprise three process variables, three 
1 5 relative position measurements (x3 1 , x32, and x33) of the motherboard and of the 
power source. There are two y-variables, two measured voltages 0^3 1, y32) on the 
mounted computer. As previous steps, the data are centered and scaled. 



In this step 23, the influence of steps 21 and 22 is modeled by means of the three 
20 scores resulting in the step 21 and step 22 models. These three vectors (t41, t42, and 
t5) are appended to the X-matrix of step 23 to give totally six variables in X6 (x3 1, 
x32, x33, t41, t42, and t5) of step 23 . 
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The PLS analysis of these data gives three components, denoted t61, t62, and t63, 
and step 23 data (X6 and Y6), scores, and model coefficients (w*, c, and b) are 
shown below in table 7. The prediction set observation 7 fits the model, while no 6 
is a significant outlier as shown in table 7. In a DmodX-plot no 6 would be signifi- 
cantly outside its normal range, indicating that this observation deviates from the 
model of the normal observations and classified as an outlier 



Table 7 



obs/vec 


x61 


x62 


X63 


t41 


t42 


t5 


y61 


y62 


t61 


t62 


t63 


DmodX 


PModX 


1 


0,409 


-0.12 


0.18 


0.28 


0.062 


-0.58 


0.633 


-0,128 


0.05 


0.644 


0,427 






2 


-0.098 


0.086 


-0.013 


-0.553 


0,143 


0.266 


-0,446 


-0.189 


-0.312 


-0.28 


-0.36 






3 


0,099 


0.479 


0.301 


0.951 


-0,127 


0,752 


0.411 


1.31 


1.321 


-0.226 


-0,065 






4 


-0.156 


0.075 


-0,086 


-0,175 


0.434 


-0.598 


0.422 


-0.875 


-0.448 


0,587 


-0.299 






5 


-0.254 


-0,52 


-0,382 


-0.503 


-0.613 


0.16 


-1,02 


-0,117 


-0.611 


-0.725 


0,297 




















pred 

yi 


pred 
y2 












6 


-0.353 


-0.999 


-0.683 


0,963 


-0,048 


0,816 


-0.573 


1,002 


0,494 


-0.78 


0.406 


5.555 


0.019 


7 


0 


-0.2 


-0,1 


1,366 


-0.213 


-0.82 


1.072 


0.358 


0.614 


0.81 


0.703 


4.143 


0.057 




w1 


W2 


w3 


w4 


w5 


w6 


Cl 


c2 












w* and c1 


0,189 


0.336 


0.282 


0,765 


-0.07 


0.427 


0,474 


0,929 












w* and c2 


0,22 


0.178 


0,188 


0,255 


0.496 


-0.757 


1.009 


-0.534 












w* and c3 


0.502 


-0.552 


0,061 


0,222 


-0,595 


-0.206 


-0.051 


0.313 












by61 


0.286 


0.367 


0.32 


0.609 


0.498 


-0.551 
















by62 


0,215 


0.044 


0.181 


0,643 


-0.517 


0,736 

















With Figure 2, the two prediction set observations are then used in the prediction 
phase of the sequential analysis. The prediction set (observation 6 and 7) give the 
values of scores and residual standard deviations (DmodX) shown above. It is seen 
that observation 6 is rather far away from the model and is a significant outKer. 
With more variables it would definitely be even clearer. A contribution plot would 
show that the mam variables deviatmg are x3 1 and x33, i.e., two of the step 23 pro- 
cess variables. 

Distances to the model (residual standard deviations) of the five t raining set obser- 
vations (1-5) and the two prediction set observations. The first one (no 6) is seen to 
be outside the critical limit, and hence classified as an outlier. 



Transmitting information and data between tiie different steps can be perfonned in 
different directions. In Figure 2, step 23 may also transmit information and data to 
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Step 21 and/or step 22. Analogously in Figure 1, step 13 may also transmit infomia- 
tion and data to step 12. 



In flie following text the invention will further be described in detail. Data are di- 
5 vided into blocks for each step, with indicating process data measured on stepy 
and Yj iadicating quality and other result data measured on the same step. Figure 5 
shows the data structure for a simple process with four steps (71,72,73, and 74) with 
two merging branches in the final step 74. The scores tj (t7, t8, t9, and tlO) carry the 
infomiation of Xj (X7, X8, X9, and XIO) to later steps, and the scores Uj (U7, U8, 
10 U9, and UIO) summarize the Y-block (Y7, Y8, Y9, and YIO) of the same step. 

For simplicity we assume only one significant componbit for each step. In reality, 
of course they are usually more. 

15 Hence, the model estimate ia phase one has a number of sub models, one for each 
step (71 to 74 in Figure 5), plus a mechanism for carrying the sequential transfer of 
quality parameters firom a step forwards (down stream) in the chain. 

There are several possible variants of algorithms to estimate the sequential model 
20 fi-om the training set. 

A simple algorithm would be to start with a simple PLS model for each step being 
leftmost in a chain, above step 71 and step 73. The nxmiber of components in each 
step model (Aj) is determined so that the scores of each step (tj) adequately capture 
25 the systematic variation in the corresponding Xj matrices. These scores are then in- 
cluded among the X-variables in the next model to the right, either as just exten- 
sions of the X-block, or, as separate blocks, one per component. Thus, in the second 
variant, if there were Aj components in the model to the left of the present stqp, 
there will be l+Aj blocks in a hierarchical PLS model of the present step. 



30 
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The resulting score(s) of the second step models (one per chain m this example) are 
then carrying the information to the next step to the right in the chain, etc., imtil ei- 
ther the process chain finishes, or merges with another chain as in Figure S. 

In stqps where several chains merge, the procedure is the same, except that a set of 
scores appear Scorn each chain, and the extension of X includes all these scores, ei- 
ther just as additional variables, or, as a set of one variable blocks, Aj+A^ in number, 
assuming that the previous models in two merging chains were Aj and A^ , respec- 



The model is now finished, and can be used in a prediction phase (with additional 
variables, data etc.) starting with the earliest steps, and sequentially moving the re- 
sulting scores down the chain(s) together with the variables measured in each sub- 
sequent step. 

In a more elaborate model, one can weave the estimation back and forth, using the 
model with only one component above as a start. Then, in the '"back-ward" phase, 
the models are updated in a standard NIPALS fashion starting fi^om the rightmost 
(final) Y-block. That will, to begin with, produce a u-vector for this final block, 
which then is carried backward to previous blocks together with its Y-summaries 
(Uj), giving after one NBPALS-PLS round a joint u-vector for the previous step, 
which then is carried backwards another step, etc. Once the iend is reached, one has 
t-scores for the lefhnost step sub models, and the directions are changed to for- 
wards, etc., until convergence. 

The X-blocks of all steps are then deflated by t*p* , and a second component started 
just as in any hierarchical PLS model. 

After an adequate number of model components (cross-validation or other estimar 
tioa of model complexity), the model is finished, and can be used in a prediction 
phase starting with the earliest steps, and sequentially moving the resulting scores 
down the chain(s) together with the variables measured in each subsequent step. 



tively. 
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1. A method for monitoring of and fault detection in an industrial process, compris- 
ing at least a first sub-process and at least one second sub-process arranged in a pro- 
S cess chain, comprising, for the at least one second sub-process the steps of collect- 
ing data and calculating a multivariate sub-model based on the collected data, said 
method being characterized by the steps: 

- receiving in the first sub-process fi*om the at least second sub-process informa- 
tion related to the multivariate sub-model calculated for the at least second sub- 

10 process, 

- collecting data related to the first sub-process, and 

- calculating a multivariate sub-model for the first sub-process based on collected 
data and received information. 

15 2. A method according to claim 1, characterized by the step of transmitting infor- 
mation or data related to the multivariate sub-model calculated for the first sub- 
process to a third sub-process. 

3. A method according to claim 1 and 2, characterized by the step of performing 
20 information or data feedback fi*om the first sub-process to the at least one second 

sub-process. 

4. A method according to any one of the preceding claims, characterized in that the 
data collected for each sub-process comprises process data. 

25 

5. A method according to claim 1, characterized in that the step of transferring in- 
formation received comprises sequential transferring of quality parameters by 
means of multivariate sub-model score values (tl,t2,. . .,tn) between the sub- 
processes in the process chain. 

30 

6. A method according to any one of the preceding claims, characterized in that ar- 
ranging the collected data for the first sub-process in one matrix and calculating the 
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sub-model for the jSrst sub-process using a principal component analysis like 
method 



7. A method according to any one of the preceding claims, characterized in that ar- 
S ranging the collected data for the IBrst sub-process is in a first (X) and a second (Y) 
matrix and calculating the sub-model for the first sub-process using a PLS like 
method. 



8. A method according to claim 7, characterized by first matrix (X) comprises pro- 
10 cess data and the second matrix (Y) comprises quality data. 

9. A method according to any one of the preceding claims, characterized by defin- 
ing at least one plot, such as score plots, residual plots, residual standard deviation 
(DmodX) plots, contribution plots, or scaled raw data plots for the interpreting the 

1 5 models and occurring process faults. 

10. A method according to claim 9, characterized in that outlier detection is pro- 
vided by analysis of said at least one plot 

20 1 1 . A method according to any one of the preceding claims, characterized by using 
a number of multivariate sub-model observations comprising a prediction set to 
simulate the process chain. 

12. A method according to any of the preceding claims, characterized by using a 
25 number of multivariate sub-model observations comprising a prediction set to per- 
form on-line monitoring in the process chain. 



13. A first apparatus for monitoring of and fault detection in an industrial process 
employing multivariate data methods, said first apparatus comprising calculating 
30 means for calculating a first multivariate sub-model for a first sub-process, said first 
apparatus being characterized in that it comprises means for receiving fi-om at legist 
a second sqpparatus information or data related to at a least second multivariate sub- 
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model calculated for at least a second sub-process in the industrial process and that 
said calculating means is arranged to calculate the first multivariate sub-model 
based on the information or data received from said apparatus and said second sub- 
process. 



14. A first apparatus according claim 13, characterized in that it comprises means 
for transmitting information or data to a third apparatus. 

15. An apparatus according to claim 13 and 14, characterized by means for per- 
forming information or data feedback to the second apparatus. 

16. A computer program product comprising computer readable code means which, 
when run on a computer system, makes the computer system perform the following 
steps: 

- receiving information or data firom a first sub-process 

- receiving information or data related to a second multivariate sub-model calcu- 
lated at a second sub-process 

- calculating a first multivariate sub-model based on the data received firom said 
second multivariate sub-model and said first sub-process. 

17. A computer program product according to claim 16 comprising computer read- 
able code means which, when run on a computer system, makes the computer sys- 
tem perform the following additional step: 

- transmittmg relevant information or data to a third sub-process. 
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